Learning Sorting Networks By Grammars
نویسندگان
چکیده
A compare-exchange network, or CMPX-net, is a sequence of operations of the form [i : j], each of which operates on an array, D, of length N. The network is said to have width N. The length of the network is the number of CMPX’s in the network. For each [i : j], we have i < j and i, j E [0, N 11. To apply a CMPXnet to an array, swap O[i] and O[j] if D[i] > O[j] for each [i : j] in the sequence. A sorting networlc(SNet) is a CMPX-net which will sort D’s contents into nondecreasing order no matter how D’s contents are ordered initially. A merging network (MNet) is a pair containing a CMPX-net of even width, N, and a partition of the indices into two equal-size sets or “sides.” If the data on each side of the partition are sorted initially then the output will be sorted. The space of CMPXnets with n, CMPX’s and width N is large, of size C(N; 2)‘% With MNets, the space is still bigger, since we must multiply the number of networks by the number of partitions, C(N; N/2). We use a genetic algorithm(GA) to search for CMPX-nets which are SNets or MNets. The GA repeatedly samples the space of potential solutions in a series of “generations,” each using the relative “fitness” of the previous generation’s samples to apportion more samples in promising regions. Mutation and especially cross-over operators are applied to generate similar but novel new sample points; this process is iterated until some stopping criterion is achieved. Hillis has had encouraging success using a GA to evolve sorting networks( Hillis 1991). In our work, we represent CMPX-nets by grammars which describe CMPX-nets. Terminals define particular CMPX sequences and nonterminals specify ways in which larger networks are built from smaller ones.
منابع مشابه
Stochastic Context-Free Grammar Induction with a Genetic Algorithm Using Local Search
We have previously used grammars as a formalism to structure a GA's search for program called sorting networks (SNets) [KBW95]. In this paper we restrict ourselves to stochastic context-free grammars which, while more analytically tracxtable than our SNet grammars, are more difficult than others previously considered by the GA community. In our approach: production rules of a grammar are encode...
متن کاملML-Tuned Constraint Grammars
In this paper we present a new method for machine learning-based optimization of linguist-written Constraint Grammars. The effect of rule ordering/sorting, grammarsectioning and systematic rule changes is discussed and quantitatively evaluated. The F-score improvement was 0.41 percentage points for a mature (Danish) tagging grammar, and 1.36 percentage points for a half-size grammar, translatin...
متن کاملA Comparison of Rule Extraction for Different Recurrent Neural Network Models and Grammatical Complexity
It has been shown that rules can be extracted from highly non-linear, recursive models such as recurrent neural networks (RNNs). The RNN models mostly investigated include both Elman networks and second-order recurrent networks. Recently, new types of RNNs have demonstrated superior power in handling many machine learning tasks, especially when structural data is involved such as language model...
متن کاملInvestigating the Adoption Rate of Students' Mental Model with the Structure of the Learning Management System of the University of Tehran by Card Sorting Method
Background and Aim: E-learning is an important topic in the educational settings and students are significant prerequisites of it, who have an essential role for the acceptance and effective use of e-learning management systems so that knowing their attitudes and mental models is essential for the successful implementation of such a method. Therefore, the aim of this study was to investigate...
متن کاملExtracting and Learning an Unknown Grammar with Recurrent Neural Networks
Simple secood-order recurrent netwoIts are shown to readily learn sman brown regular grammars when trained with positive and negative strings examples. We show that similar methods are appropriate for learning unknown grammars from examples of their strings. TIle training algorithm is an incremental real-time, recurrent learning (RTRL) method that computes the complete gradient and updates the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1994